Spectral Analysis and the Dynamic Response of Complex Networks 
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The eigenvalues and eigenvectors of the connectivity matrix of complex networks contain infor- 
mation about its topology and its collective behavior. In particular, the spectral density p(A) of this 
matrix reveals important network characteristics: random networks follow Wigner's semicircular 
law whereas scale-free networks exhibit a triangular distribution. In this paper we show that the 
spectral density of hierarchical networks follow a very different pattern, which can be used as a 
fingerprint of modularity. Of particular importance is the value p(0), related to the homeostatic 
response of the network: it is maximum for random and scale free networks but very small for 
hierarchical modular networks. It is also large for an actual biological protein-protein interaction 
network, demonstrating that the current leading model for such networks is not adequate. 



The network concept has been gaining recognition as 
a fundamental tool in both biological and social sciences, 
where the theory of complex systems finds fertile ground. 
Biological examples include food webs in ecology 1], ner- 
vous systems j^ , cellular metabolism _3j , protein confor- 
mation |j] and a protein-protein interaction network [5J. 
Social networks include scientific collaboration, citation, 
problem solving and linguistic networks |g. Most bi- 
ological and social networks studied are not randomly 
connected, they follow a scale free behavior (see p] and 
references therein). In random networks the probabil- 
ity that a node has k connections, P(fc), is Poisson dis- 
tributed and, therefore, every node has about the same 
number of connections. In scale free networks -P(fc) fol- 
lows a power law, a property that can be constructed by 
sequential preferential attachment of nodes, where new 
nodes are more likely to connect to already highly con- 
nected ones. The properties of such networks are often 
characterized by the presence of a few highly connected 
nodes, the hubs, whereas most of the remaining nodes 
have a small number of connections. The importance of 
such networks, originally couched in terms of robustness 
of static connectivity to failure despite sensitivity to at- 
tack iQl , may perhaps be better characterized in terms of 
their response dynamics, that provides both robustness 
and sensitivity'!||. 

Although scale free networks describe several statis- 
tical properties of biological networks, they fail to take 
into account one important aspect, namely, the modu- 
larity exhibited by most complex systems 10, 11]. The 
concept of modularity assumes that the full network of 
interactions can be partitioned into a number of sub- 
networks or modules. Each module is composed of sev- 
eral elements which are more interconnected than they 
are connected to the rest of the network. In real sys- 
tems a module is expected to perform an identifiable task, 
separable from the functions of other modules |llL Il3 | . 
Modular systems may be organized in a structural hi- 
erarchy, with multiple levels of modular decomposition. 
Molecules, organelles, cells, tissues, organs and organ- 
isms, families, communities, etc., are an example of such 
a hierarchy of structures. Networks incorporating both 
modular hierarchy and scale free character were recently 



discussed by Barabasi [iJl (see also [T^)- One prop- 
erty often used to characterize modular networks is their 
clustering coefficient — the degree to which neighbors of a 
node are connected to each other — which is larger than 
that of generic scale-free models. 

In this work we investigate the spectral properties of 
modular networks. We show that the density of states 
of the connectivity matrix (particularly its randomized 
version where elements are set to ±1) provides a connec- 
tion between the structure and the dynamic response of 
a network. This enables us to distinguish between vari- 
ous models and actual systems in a manner that may be 
directly relevant to considering the behavior of system re- 
sponse to perturbations. In particular, we are able to dis- 
tinguish clearly between random, scale-free and modular 
networks. However, none of these standard model net- 
works capture the properties of an actual protein-protein 
interaction network. 

The connectivity (or adjacency) matrix A represents 
the topology of the system, indicating which variables 
are interconnected. It is defined as Aij = 1 if nodes i 
and j are connected and zero otherwise. The spectral 
properties of this network may be used to characterize 
the topology. If we consider the network as an influence 
network, where each link may have a strength and phase 
that is not specified, a model of the interactions between 
nodes Aji can be constructed from A by changing each of 
the entries 1 of A into — 1 with 50% probability (keeping 
Aij = Aji, since they represent the same connection). 
The spectral properties of An contain information about 
the dynamics of the network. If the network is in equilib- 
rium and a perturbation is introduced, this perturbation 
propagates through the nodes according to Af;. In a lin- 
ear approximation the state of the nodes are updated 
according to x*'^^ = ^j AjujX^j. Below we study the 
spectral properties of A and An and show they are in 
many cases similar, or otherwise can be related. 

The smoothed density of states of the network is de- 
fined by 
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FIG. 1: Smoothed density of state for a random, scale free, 
Barabasi's hierarchical network (all with 1024 nodes) and the 
protein- protein interaction network (with 1297 nodes). 
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FIG. 2: Smoothed density of state for the randomized net- 
works of Fig.l. 



where A^ are the eigenvalues of the connectivity matrix 
and N is the total number of nodes. Since the A is sym- 
metric all eigenvalues are real. Se (x) is a smoothed delta 
function that tends to the real Dirac delta as e ^ 0. 
Choosing e to be a few units of the mean level spacing 
produces a smooth level density even for small networks, 
which is easier to visualize than the spiked density pro- 
duced by the delta functions. Following Farkas et al [I3 
we define scaled variables p and A by 



A = 
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where p — k/N is the average number of links per node 
divided by the total number of nodes. For random net- 
works the density of states can be computed analytically 
from random matrix theory and the result is the so called 
Wigner's semicircular law. In the scaled variables it be- 
comes simply p(A) = ^A — \^ /2-k if |A| < 2 and zero 
otherwise. 

Figure 1 shows the density of states for four differ- 
ent networks. All networks have TV = 1024 nodes, ex- 
cept for the protein-protein network which has N = 
1297. Fig. 1(a) shows p{X) for a random network with 
p = 0.0057, following closely Wigner's semicircular law. 
Fig. 1(b) shows a Scale Free network with p — 0.0058, 
exhibiting a triangular profile [13. Fig. 1(c) , correspond- 
ing to Barabasi's hierarchical network [13, has a pecu- 
liar density, that we shall discuss in more detail. Finally 
fig. 1(d) shows p(A) for a protein- protein interaction net- 
work |y| and also has a distinct behavior, looking more 
like a superposition of two independent scale free net- 
works. 

Figure 2 shows the density of states for the same net- 
works obtained with the randomized connectivity matri- 
ces Afj. For each network we diagonalized 20 matrices 
with random distributions of ±l's and calculated the av- 
erage density over this ensemble. The averaged density 



satisfies p{\) = p(— A). The scale free and random net- 
works are not sensitive to sign randomization, since their 
original spectra are already symmetric. Barabasi's hi- 
erarchical network density of states, on the other hand, 
changes considerably. It keeps the minimum at A = 0, 
whereas all other networks have a peak there. Also, the 
density has sharp peaks with high intensity at certain 
values of |A|, becoming very small away from the peaks. 
The biological network also has an interesting structure, 
deviating from the pure scale free case. However, in con- 
trast to Barabasi's network it has a peak at A = 0. 

Barabasi's hierarchical network is built from a fully 
connected network with 4 nodes. This unit is then repli- 
cated three times and the four identical networks are con- 
nected together. The network thus formed is then viewed 
as the new unit, and the replicating and connecting pro- 
cess is repeated [I^- Although the exact repetition of 
this process is artificial, one expects real modular net- 
works to exhibit some type of self-similar structure. In 
what follows we shall show that networks built from such 
basic units have indeed a very characteristic spectrum, 
that can be used to identify its modular nature. 

Consider first a fully connected network with N nodes. 
The connectivity matrix is {Aiq)ij = 1 — 5ij. The eigen- 
values of Aiq can be calculated immediately and we find 
Al = iV - 1, A2 = A3 = ... = \n = -1- The first 
eigenvector \wi), corresponding to the largest eigenvalue 
Al, has components wi^i — 1. All the other eigenvectors 
are degenerate and satisfy ^^ Wj^i = 0. It is possible to 
choose them so as to have very few non-zero elements. 
The linear update equations a;*+^ — A^x^ decouples into 
2/'"*"^ = Xiyl and j/* = \\yf- The dominant mode is the 
'center of mass' yi, meaning that the network synchro- 
nizes and responds as a unit to the perturbation. All 
other modes involve fewer nodes and correspond to os- 
cillations of fixed amplitude. The density of states for 
a fully connected network has only two peaks: one at 
A = — 1 and the other at A = A*" — 1, the former being 
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FIG. 3: Smoothed density of state for Barabasi's hierarchical 
network for the original and the randomized connectivity ma- 
trix with A'^ = 16, 64 and 256 nodes. The smoothing param- 
eter is 5 times the average level spacing, except for A^ = 16, 
where it is 2 times the average level spacing. 



A^ — 1 times larger than the latter. 

Next we consider star networks, which are character- 
ized by a single hub, i.e., a single central node to which 
all other nodes are connected. Star networks emerge in 
systems in which preferential attachment is superlinear, 
meaning that the probability that a new node attaches to 
old nodes increases faster than expected by linear pref- 
erential attachment [l^ ■ Star-like clusters are very com- 
mon in biological networks (see for instance [13) and 
their eigenvalues and eigenvectors can also be computed 
exactly. In the idealized star network the nodes con- 
nect only to the central node, which we label 1. The 
connectivity matrix is given by An — An = 1 for 
i — 2,3, ...,-/V and Aij = otherwise. The eigenval- 
ues are Ai = \/N — 1, A2 = A3 = ... = Ajv_i = and 
Xn = —^/N — 1. The first eigenvector \wi) has com- 
ponents wii = \/N — 1 and wu = 1 for i > 2. The 
last eigenvector \wn) is given by wni — ^/N—l and 
WNi = — 1 for i>2. All the others degenerate eigenvec- 
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tors satisfy Wj^i = and X]i=2 '^3 

Now we consider a network whose connectivity matrix 
has a modular organization consisting of 4 main blocks, 
each one very similar to the others. The number 4 is 
chosen only for comparison with Barabasi's model, but 
could be any number. We assume that the blocks are 
fully connected, so that we know their eigenvectors and 
eigenvalues when they are decoupled. Let \wf) be the 
i — th eigenvector of the block labelled by a. Since the 



blocks are all identical, the eigenvalues are degenerate: 
A^* = M - 1 and Af = -1 for i ^ 1, where M is the 
dimension of the blocks. The connectivity matrix can 
represented in block form by 
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where Am are fully connected M by M matrices, AP is 
the unperturbed medibi, with the 4 uncoupled Am blocks, 
and y is a sparse perturbation, representing the weak 
connection between nodes of different blocks. 

The perturbation breaks the degeneracy between the 
blocks. The first eigenvalue becomes A = Aq + /i and 
the corresponding eigenvector |w") = X]/3 °'a/3l'"'i ) + 10 
where the sum over (3 runs over the blocks and represents 
the linear combination between the originally degenerate 
vectors and the last term is the correction due to the 
perturbation. Writing the eigenvalue equation for \vf) 
and keeping only linear terms in the perturbation V leads 
to the condition 
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For all the other eigenvectors, whose degeneracy is 
much bigger, we write \v") = J2i3m (^a'pl^m) + \0 where 
the sum now runs over P and m, with n,m ^ 1. The 
eigenvalue equation for this case is 
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However, each matrix element (w^jV^lw^) is obtained by 
adding elements of the matrix V with coefficients that 
add up to zero. Since V is sparse, we expect most of these 
elements to be zero and, when they are not zero, there 
will likely be cancellations. Therefore, the corrections to 
the eigenvalues are going to be small, and the density of 
states of A should still have a large peak around A = — 1. 
On the other hand, the elements of jwf ) are all 1 inside 
the (3 block and zero outside: 
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where Ka0 is the number of 1 's in the block Vap ■ At this 
point we have to distinguish between random and scale 
free networks: 

random coupling - We can assume that all the 
coupling blocks Vap are similar, so we write Kap = a 
where a is the average number of I's in each of the v 
blocks. The 4x4 matrix to be diagonalized in Eq.l^J is 
identical to the connectivity matrix of a completely con- 
nected network of 4 nodes. Therefore, the 4 uncoupled 
eigenvalues M — 1 unfold into 1 eigenvalue M — 1 -f 3a 




and 3 eigenvalues M — 1 — a. For random coupling we 
expect three main peaks in the density of states: a large 
peak at A = —1, a smaller one at M — 1 — a and an even 
smaller one at M — 1 + 3a. 

scale free coupling - In this case the blocks are them- 
selves not connected randomly, they attach preferentially 
to, say, the first block. The 4x4 matrix to be diagonal- 
ized has the form 



(7) 



where a >> b. In first approximation we neglect b and 
the resulting matrix is that of a 4 x 4 star network. There- 
fore, the eigenvalues become: M— 1 — \/3a, M — 1 (doubly 
degenerate) and M — 1 + \/3a. Together they contribute 
a single symmetric peak around M — 1 with half width 
\/3a. Therefore, for scale free modular matrices we ex- 
pect only two main peaks in the density of states: a large 
one at A = — 1 and a smaller one at A = M — 1. 

Figure 3 shows the density of states for Barabasi's hi- 
erarchical network with 16, 64 and 256 nodes. The two 
peaks structure is clear and consistent with our analysis 
of a modular scale free network. The protein network 
shown in Fig.l is certainly not completely modular. But 
it is also not generically scale free either. The two peaks 
at zero and —1 (in non-scaled units) suggest the exis- 
tence of many star like structures (where the eigenvalue 
abounds) and many fully connected modules (where 
the eigenvalue -1 abounds). 

Randomized connectivity matrices. A similar analy- 
sis can made for the case of the randomized connectiv- 



ity matrices. For example, starting from a single fully 
connected unit of 4 nodes, the eigenvalue equation can 
be seen to be A'* — 6A^ — 2A(a23a24a34 + 012024014 + 
012013023 + 013O14O34) - 2(012013024034 -I- 012O14O23O34 -I- 
014O13O24O23) -1-3 = 0. For random o^'s, the term mul- 
tiplying A averages to zero, whereas the constant term 
in parenthesis averages to either -1 or -1-1. The averaged 
equation is A'' - 6A2 -h 1 = or X^ - 6\^ + 5 = 0. The 
result is a spectrum with two pairs of symmetric eigen- 
values. When a modular network is constructed out of 
these random units, we obtain a density of state with four 
symmetric peaks. This can be seen in Fig. 3 for Barabasi's 
network with 16, 64 and 256 nodes. 

To summarize, we have introduced some conven- 
tional but powerful tools into the discussion of networks, 
namely, linear algebra and perturbation analysis. We 
have shown that the density of states contains crucial 
information not only about the topology of the network 
but also about its response to external perturbations. By 
comparing p(A) for a random, a scale-free and Barabasi's 
hierarchical network, we have shown that it exhibits clear 
fingerprints of the networks they represent. More im- 
portantly, we have shown that neither of these model 
networks can describe the density of states of a real 
protein-protein interaction network, showing that bet- 
ter network models are necessary to understand biolog- 
ical systems. In particular, the behavior of /)(0), which 
indicates that the real biological network has a robust 
homeostatic response, is not reproduced by Barabasi's 
hierarchical model. Our analysis also indicates the pres- 
ence of several star like and fully connected modules in 
the biological network, suggesting that these structures 
might have to be incorporated explicitly in more realist 
models. 
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